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LOCAL OPTIMIZATION OF BLACK-BOX FUNCTION WITH HIGH 
OR INFINITE-DIMENSIONAL INPUTS. 
APPLICATION TO NUCLEAR SAFETY. 

ANGELINA ROCHE 


Abstract. An adaptation of Response Surface Methodology (RSM) when the covariate 
is of high or infinite dimensional is proposed, providing a tool for black-box optimization 
in this context. We combine dimension reduction techniques with classical multivariate 
Design of Experiments (DoE). We propose a method to generate experimental designs 
and extend usual properties (orthogonality, rotatability,...) of multivariate designs to 
general high or infinite dimensional contexts. Different dimension reduction basis are 
considered (including data-driven basis). The methodology is illustrated on simulated 
functional data and we discuss the choice of the different parameters, in particular the 
dimension of the approximation space. The method is finally applied to a problem of 
nuclear safety. 


Keywords: Functional data analysis. Response surface methodology. Design of experi¬ 
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1. Introduction 

Black-box optimization problems arises in many applications, for instance when one 
wants to optimise an output of a computer code or in real-life experiments such as crash 
test, chemical reactions, medical experiments... In more and more applications, the input 
is high-dimensional, or even inhnite-dimensional (time or space dependent). In this paper, 
our aim is to minimise an unknown function m : 7^ —)■ M where 7^ is a subset of a separable 
Hilbert space (H, ■), || • ||), which can be e.g. or a function space. The function m is 

unknown, but noisy evaluations of m are available. We suppose that each evaluation of 
m is costly, thus the aim is to be as close as possible to an optimum with a given (low) 
number of evaluations of m. 

In this context, surrogate-based approaches, such as those based on response-surface 
methodology, kriging, radial basis functions, splines or neural networks are commonly used 


(Queipo et al., 2005 Simpson et ah, 2001). In Response Surface Methodology (RSM), the 
function m is locally approximated by a polynomial regression model, typically with order 
1 or 2 (see e.g. the review of Khuri and Mukhopadhyay, 2010). With the information 


given by the evaluation of the function m on design points chosen by the user, least- 
squares estimates of the model parameters provide a local approximation of the surface 
y = m{x). This local approximation can be used, for instance, to approximate the gradient 
or to locate a critical point of the surface. The efficiency of the method rests mainly on the 
choice of the design of experiments. Hence, a lot of research has been done in order to find 
sets of points giving the best possible precision of the fitted surface with few evaluations 


Date: November 19, 2015. 


1 













2 


A. ROCHE 


of m on the design points. We refer to |Khuri and Mukhopadhy^ 


the description of the most common response surface designs, 
active research held (see e.g. 


Georgiou et al. 2014). 


pp. 131-133 for 
This subject is still an 
However, these design generating 
methods are not tractable when the inputs are high-dimensional (for instance, El = 
with d > 100) and can not be directly dehned with inhnite-dimensional inputs. 

Projection-based dimension reduction techniques has become a powerful tool in high¬ 
dimensional statistics and are the main tool of most of the methods used to treat functional 
data. Usually, the data are projected into a subset S = Vect{(pi, ...,(pd} C El of reduced di¬ 
mension. In functional data analysis, El is a function space and hxed basis such as Fourier 
basis, spline or wavelet basis are commonly used, exploiting the regularity properties 
(smoothness for instance) of the functions in the sample. Another interesting approach 
consists in using the information given in a learning sample of pairs {(W, ^i)u = l,...,n} 
to generate the directions <pi, ...,(pd- Among them the approaches based on the principal 


components are the most common: PCA (Hall, 2011), sparse PCA (Zou et ah, 2006 Qi 


and Luo, 2015), regularized PCA (Rice and Silverman, 1991 Lee et al., 2002 Ramsay 


and Silverman, 2005). Another approach to obtain interesting data-driven basis is Par¬ 
tial Leasts Squares regression (PLS, Wold, 1975 Preda and Saporta, 2005). The main 
advantage of PLS is that the directions <pi,..., are chosen in El so as to maximize the 
explained variance of Y. Hence, PLS uses the information of the whole learning sample 
{(Xj, Yi),i = 1,...,?7,} whereas the PCA basis is generated only with the Xj’s. 

The present paper proposes an adaptation of Response Surface Methodology when the 
input is in a general Hilbert space El, via dimension reduction techniques. The specihcities 
of the framework are explained in Section In Section we provide a way to generate 
RSM design of experiments based on dimension reduction tools. A simulation study is 
presented in Section The method is hnally applied in Section to a nuclear safety 
problem. 


2. High-dimensional and functional context 


We suppose here that our real response y depends on a variable x in an inhnite or 
high-dimensional space El equipped with a scalar product (■, ■). For instance, El may be 
the space equipped with its usual scalar product (x, y) = J2j=i ^jVj ^ function 
space, such that L^(/) with / a measurable subset of and {f,g) = f{t)g{t)dt. We 
denote by || ■ || the associated norm (i|x|p = {x,x) for all x G El). 

We suppose here that the function m is sufficiently smooth, so that the surface y = m{x) 
can be approximated reasonably by a hrst or second-order surface. We consider here 
generalizations of the classical multivariate hrst and second-order models. Higher-order 


polynomial models, or even generalized linear models (Muller and Stadtmiiller, 2005 


Khuri, 2001), while less standard, could also be considered similarly. 


2.1. First-order model. We dehne hrst-order models in the following form 

y := a + {l3,x) + e, 

with a G M, /3 G El and £ ~ 7V(0 ,ct^). If EI is a function space, this model is known 


as functional linear model ( 

Ramsay and Dalzell 

1991 

Cardot et al. 

1999 

) and has been 

widely studied (see 

Cardot and Sarda 2011 

for a recent overview or 

Brunei et al. 

2016 


for a recent work on this subject). Moreover, it is known that, if EI is of high or inhnite 
dimension, least-squares estimators of the slope parameter f3 are, in general, unstable. 
Hence, precautions must be taken, either in the choice of the design (see Section]^, or in 
the estimation method for the parameter fd which is an ill-posed inverse problem (|Engl 
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The interest of this model is that, if m is differentiable, for all Xq € H, 
m{x) = m{xo) + {m'{xo),x — Xq) + o(||x — Xo||), where m'(xo) is the gradient of m at the 
point Xq, which implies that, if x is sufficiently close to Xq, an estimator of /3 will estimate 
the gradient of the surface y = m{x) around the point xq. 

2.2. Second-order model. A second-order model can also be written as follows 

(1) y:= a + {/3,x) + ^{Hx,x) +e, 

where a G M, /3 G El and H : El —)■ El is a linear self-adjoint operator. Up to our 
knowledge, this model (at least in this particular form) has not been studied yet in the 
literature of functional data analysis. As for the hrst-order linear model, classical least- 
squares estimation is not a good choice and we have to be careful either in the choice 
of the design, or in the estimation method. If El = M'^, the operator if is a symmetric 
and positive semi-dehnite matrix H = {hi,j)Ki and the model ([^ is the classical 
second-order multivariate linear model which can be written 

d d d 

y = a + ^ (3jXj + ^ hj^kXjXk + ^ hjjx'^j + e. 

i=i j,k=i j=i 

j<k 

As for the second-order model, if m is twice differentiable and if the design points are 
sufficiently close to xq, an estimator of (3 is an estimator of the gradient of m and an 
estimator of H gives an estimator of the Hessian matrix of m. In particular, if xq is close 
to a critical point, then the estimator of f3 is close to 0 and the estimator of H may help 
to precise the exact location and the nature of the critical point. 

3. Generation of Design of Experiments 

3.1. General principle. The method is based on dimension reduction coupled with 

classical multivariate designs. The main idea is the following: suppose that we want 
to generate a design around xq G EI, we choose an orthonormal basis of El, a 

dimension d and a d-dimensional design {xj ,i = 1,... ,n} = {(xj^i,..., Xi^d),i = 1,...,n} 
around 0 G and we define a functional design {xj, i = 1,..., n} verifying 

d 

( 2 ) Xi:= Xo + '^Xijifj. 

i=i 

The advantage of such a method is its flexibility: all multivariate designs and all basis 
of EI can be used. Then, by choosing an appropriate design and an appropriate basis, we 
can generate designs satisfying some constraints defined by the context. 

Remark that {ipi, ..., (pd\ can be seen as predehned optimisation directions in the sense 
that the input x will vary exclusively in the directions of the space span{(pi,..., (p^}. 
Therefore their choice have a great influence on the precision of the results and has to be 
made carefully. 

3.2. Data-driven directions of optimisation. If a training sample {(Xj, Yi),i = 1,..., n 

is available, with Xj G EI, for all i and IE[Xj] = m(Xj), it may be relevant to use the infor¬ 
mation of this sample to find a suitable basis. We consider here two method to generate 
data-driven basis: 


et ah 1996 
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Principal Components which is the basis of El verifying 


n 


Y, 11^. - = min ^ ||X, - n,x, 


2 = 1 


2=1 


where 11^ is the orthogonal projector on span{(y9i,..., (pd}, || ■ || is a norm on the 
space El and the minimum on the right-hand side is taken over all orthogonal 
projectors 11^ on d-dimensional subspaces of El. 

Partial Least Squares (Wold, 1975 Preda and Saporta, 2005) which permits to 
take into account the interaction between X and Y. It is computed iteratively 
by the procedure described in Delaigle and Hall (2012). For theoretical results on 
the PLS basis see Delaigle and Hall (2012); Blazere et ah (2014). For practical 
implementation, see Algorithmic 


Data: Training sample {(Wj Yi),i = 1, ..., n} 

Initialization : 

^ n 1 ^ 


1=1 


for j = 1,..., d do 


f ?'—11 

Estimate pj by the empirical covariance of X'p and 


n 

1=1 

41-1]. 




2 = 1 


[1-1] vb-i] 




2=1 


Fit the models Y^^^ = ^ and = 5j{xY\pj) + by 

least-squares that is 

n n 


2=1 


2=1 


and 


4 := YXt\vi)x't'iY.XY,vi? 

2=1 2=1 

Define x'f"^ := 27 ^”^ _ I^X^^~^\pj)5j and y}^^ := Y^^^ — j3j{x'f~^\ipj) the residuals 
of the two fitted models; 

end 

Algorithm 1: practical implementation of PLS basis (Delaigle and Hall, 2012, Section 
A.2) 


3.3. Multivariate designs. In this article, we focus on the most classical designs. How¬ 
ever, the method we propose is flexible and can be used with any multivariate design, for 
instance Latin Hypercube Sampling (see Liu et ah, 2015, and references therein), small 


composite designs (Draper and Lin, 1990), augmented-pair designs (Morris, 2000)... We 


also refer to Georgiou et ah (2014) and references therein for the recent advances on the 
subject. 

The 2^ factorial design is one of the simplest. It is a first-order design is the sense 
that it is frequently used to fit a first-order linear model. For each explanatory variable 
Xi,..., Xd, we choose two levels (coded by 4-1 and —1) and we take all the 2'^ combinations 
of these two levels. When d is large, it may be impossible to achieve the 2^ factorial 
experiments, hence fractional factorial design keeps only a certain proportion (e.g. a half. 
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a quarter,...) of points of a 2'^ factorial design. Typically, when a fraction 1/(2^) is kept 
from the original 2'^ design, this design is called 2'^“^ factorial design. The points removed 
are carefully chosen, we refer e.g. to Gunst and Mason (2009) for more details. In our 
context, since we have the freedom to choose the dimension d, the interest of considering 
fractional factorial designs relies on its flexibility. For a given number 2^ of design points, 
all pairs (d, p) of positive integers such that d — p = k gives a different design, the choice 
d = k and p = 0 leads to the full factorial design while larger values of p allow to explore 
a higher-dimensional space keeping the number of experiments low. 

Traditional second-order designs are factorial designs, central composite designs and 
Box-Behnken designs. 

• or 3'^“^ factorial designs are similar to 2^^ and 2“^“^ factorial designs but with 
three levels (-1-1, —1 and 0). 

• Central Composite Designs (CCD) are obtained by adding to the two-level factorial 
design (fractional or not) two points on each axis of the control variables on both 
sides of the origin and at distance a > 0 from the origin. 

• Box-Behnken Designs (BBD) are widely used in the industry. It is a well-chosen 
subset of the 3*^ factorial design. Box-Behnken designs are not used when d = 2. 

7.4.7). 


For d > 4, we refer to Myers et ah (2009 


3.4. Design properties. One of the interests of the design generation method([^ is that 
all design properties (orthogonality, rotatability and alphabetic optimality) verihed by the 
multivariate design {xj,i = 1, ...,?7,} are also verihed for the design {xi,i = 1, ...,n} C H. 

To explain that we focus on hrst-order and second-order designs but the same reasoning 
may apply to other models and other kind of optimality properties related to the model 
considered. Let us hrst rewrite these models. 


First-order model. Recall that, for alH = 1,..., n, Xj = xq + then the hrst- 

order model can be rewritten 

d 

(3) yi\= a + +ei, for i = 1,..., n. 

j=i 

With our choice of design points, this model is a hrst-order multivariate model and can 
be written 


( 4 ) 


Y = X/3 + £ 


with design matrix 


/I 

Tl,l . 

■ xiA 

1 

X2,l 

X2,d 

Vi 


^n,d/ 


and coefficients /3 = (a -|- (/d, Xq), {(3, ipi),... ,{/3, Then, the hrst-order linear model 

in El is in fact a hrst-order multivariate linear model, with inputs {xj,i = 1, ...,n}. 


Second-order model. Now we can see that a similar conclusion holds for the second-order 


model, which can also be written Y 

= X/3 -|- £ with 



/l Xi^i .. 

• Xi^d Ti,1X1,2 . 

■ "''I,;! 

X = 

1 X2,l 

X2,d a^|i a;2,1X2,2 • 

^2 

• X2^d 


\1 Xn,l . . 

Xn,d ^ri,l ^n,lT^,2 

^2 

Xn,d 
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3.4.1. Design properties. An important property is the orthogonality. An orthogonal de¬ 
sign is a design for which the matrix X*X is diagonal. This implies that the vector (3 is 
also a Ganssian random vector with independent components and makes it easier to test 
the signihcance of the components of (3 in the model. 2^ factorial designs are orthogonal 
hrst-order designs. However, fractional designs have to be constructed carefully in order 


to keep the orthogonality property. For second-order designs, we refer to [Box and Hunter 
(1957) for general criteria applied to factorial and fractional factorial designs. Central 


Composite Designs are orthogonal if a = 


y + 2d + /2, where 


F is the 


number of points of the initial factorial design (see Myers et ah 2009). 


A design is said to be rotatable if Var(^(x)) depends only on the distance between x 
and the origin. This implies that the prediction variance is unchanged under any rotation 
of the coordinate axes. We refer to Box and Hunter (1957) for conditions of rotatability. 


All hrst-order orthogonal designs are also rotatable. This is not the case for second-order 
designs, for instance a CCD design is rotatable if a = which means that a CCD 
design can be rotatable and orthogonal only for some specihc values of hq and F. Box- 
Behnken designs are rotatable for d = 4 and d = 7. Some measures of rotatability have 


been introduced 

Khuri 

1988 

Draper and Guttman 

1988 

Draper and Pukelsheim 

1990 

Park et ah 

1993 

in order to measure how close a design is to the rotatability property. 


The important point is that all the design properties cited above only depends on the 
design matrix X. Hence, all properties of the multivariate design {xj,i = l,...,n} are 
automatically verihed for the design {xi,i = 1, ...,n}. 


Since all alphabetic optimality criteria (Pazman, 1986) are also exclusively based on 


properties of the design matrix X, it is possible to dehne e.g. D-optimal designs for data 
El with Equation (|^ by taking a D-optimal multivariate design. 


m 


4. Numerical experiments 
In this section, El = L^([0,1]). 


4.1. Functional designs. We use here the functions cube, ccd and bbd of the R-package 
rsm (Lenth, 2009) to generate respectively 2*^ factorial designs. Central Composite Designs 
(CCD) and Box-Behnken Designs (BBD). 


Functional designs with Fourier basis. In this section, we set ipi = l and for all j > 1, for 
all t G [0,1], 

7^2j{t) = cos(27rjf) and (p 2 j+i{t) = \/2sin(27rjf). 

The curves of the generated designs are given in Figure [Tj 

Functional design with data-driven bases. We simulate a sample {Xi,..., X„} comprising 
of n = 500 realizations of the random variable 

.7 

i=i 

with J = 50, \j = e“b (^j)j=i,...,j an i.i.d. sequence of standard normal random variables 
and i/jjit) := ■\/^sin(7r(j — 0.5)f). 

The PCA basis only depends on {Xi, i = 1,..., n}. In order to see the influence of the 
law of Y on the PLS basis we dehne two training samples < {Xi, Y^^^),i = 1,..., n i for 
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Factorial 2'^ design 


CCD 



Figure 1. Functional designs with the Fourier basis (d = 5). Gray thick 
line: Xq = 0, red lines: points of the original 2'^ or 3*^ (for BBD) factorial 
design, green dotted lines: points added to the factorial design (for CCD). 


Factorial 2'^ design 


CCD 


BBD 



Figure 2. Functional designs with the PCA basis associated to {Xi,i = 

1,... ,n} (d = 5). The legend is the same as the one of Figure 

j = 1,2 with 

;= mj{Xi) +ei, 

mj{x) := ||x — fjW^, where 

fi{t) := cos(47rt) + 3sin(7rt) + 10, 
f 2 {t) := cos(8.57rt) ln(4t^ + 10) 

and i-i.d. ~ 7V(0, 0.01). 

The curves of the design generated by the PLS basis (Figure]^ are much more irregular 
than those generated by the PCA basis (Figure]^. However, remark that the designs 
generated by the PLS basis (Figure of the two samples show signihcant differences, 
which illustrates that the PLS basis effectively adapts to the law of Y. 

4.2. Estimation of the response surface. We use here the PLS basis calculated from 
the training sample {{Xi, i = 1,... ,n} with j = 1 or j = 2. The aim is to approach 
the minimum fj of rrij : x E M. ^ ||x — /j|p. 

We use the training sample a second time to determine the starting point of the algo¬ 
rithm. We take 

:= where imin := argmin^^^^ 

The dimension is set to d = 8. 


Approximation of fi = cos(47rt) -|- 3sin(7rt) -|- 10. 
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BBD 


Factorial 2^^ design 


CCD 



Figure 3. Functional designs with the PLS basis of the training sample 
= 1,... ,n}, j = 1 (hrst line) and j = 2 (second line), d = 5. 
The legend is the same as the one of Figure [Tj 



Figure 4. Results of experiments on the direction of steepest descent for 
the estimation of /i. x-axis: Aq, y-axis: response Y = mi(x® — Ao/d*-®^) + e. 


Descent step: We generate a factorial 2^^ design (Figure 
(here uq = 2*^) and we £t a hrst-order model 


left) 





y(0) 




d 

i=i 


( 0 )^( 0 ) 

j 


+ 


( 0 ) 


to estimate the gradient. We realize two series of experiments along the line of 
steepest descent x® — Ao/3^°^ (Aq > 0). The hrst one (Figure ^ top left) suggests 
that the optimal value of Aq is between 0.4 and 0.6 and with the results of the 
second one we £x Aq = 0.50. We set Xg^^ := Xg^^ — Ao/d*^°^ 

The value of mi at the starting point was m(x®) = 70.4 ± 0.1. At this step, 
we have mi(xo^^) = 6.33 x 10“^ ± 10“^ and we have done only 2'^ + 24 = 280 
experiments to reach this result. 
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-starting point xO 


■ ■ • Minimal point of the descent step 


.Min. estim. with 2nd order model 


• - Real minmum (objective) 

——- —^ ' 


0.0 0.2 0.4 0.6 0.8 1.0 


t 


Figure 5. Result of optimization algorithm. 


We fit a first-order model once again with a 2'^ factorial design and find that the 
norm of is very small (||/3*'^^|| < 0.02) compared to ||/3^°^|| = 16.8 ± 0.1 which 
suggests that we are very close to a stationary point. We also note that the p-value 
of the Fisher’s test Hq : (3^'^ = ... = (3^^ = 0 against Hi : G {1,..., d}, (3^^ ^ 0 

is very close to 1 which tends to conhrm this assertion. 

Final step: To improve the approximation, we £t a second-order model on the 
design points given by a Central Composite Design (Figure - center). The 
matrix H at this step is an estimation of the matrix of the restriction to the space 
span{<pi,..., ipd} of the Hessian operator of m at the point All the eigenvalues 
of H are greater than 1.96 > 0, this suggests that we are close to a minimum. We 
set := —H~^I3^^'> and we have mi(xg^^) := 5.45 x 10“^ ± 10“^. The CCD with 
d = 8 counts 280 elements then we have realized 280 experiments for the descent 
step plus 280 for the hnal step, this rises to 557 the total number of experiments 
performed. Figure [^represents the different results. 

Approximation of f 2 {t) = cos(8.57rt) ln(4t^ -|- 10). We have here m 2 (a;o°^) = 2.88 ± 0.01. 

We follow the same steps as in the previous paragraph. Figure j^left represents the 
evolution of the response along the direction of steepest descent. Here, since the response 
is noisy, rehning the result without doing a too large number of experiments seems to be 
difficult. Then, we fix Aq = 0.5 and = Xg^^ — We have m 2 (xo^^) = 1.99 ± 0.01. 

At this step, we have improved the response of about 31%. This is not as important as 
the improvement of the hrst step of estimation of fi but that is signihcant. 

This time, the p-value of the Fisher’s test Hq : = ... = = 0 against Hi : 3j G 

{1,..., d}, % 0 is very small (< 2 x 10“^) which indicates that we are not close to a 

stationary point. Then, we try to improve the response doing a second descent step. 


4.3. Choice of basis. In this section, we compare the three bases proposed in Section 4.1 


We generate Ug = 50 training samples of size n = 500 and compare the results of the hrst 
descent step when the design is generated by the Fourier basis, the PCA basis and the 
PLS basis. The starting point is the same: Xg^^ = for imin = argminj^;^^ 

(then for the Fourier basis the training sample is only used to set the starting point). The 
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CO 

cvi 


cvi 


p 

cvi 


<D 


Figure 6. Results of experiments on the direction of steepest descent for 
the estimation of f 2 - 




Figure 7. Result of optimization algorithm. Black curve: Xq , orange 
curve: red curve: Xq^\ green curve: / 2 . 


results are given in Figure]^ We see immediately that the PLS basis seems to be a better 
choice than the PCA one. However, surprisingly, the choice between the PLS basis and 
the Fourier basis is less clear. 


4.4. Choice of dimension d. Figures and 10 show that, except when the design is 
generated by the PCA basis for the approximation of /i, the percentage of improvement 
increases when the dimension increases, which is coherent with the fact that the number 
of experiments grows exponentially with the dimension. 

We then decide to study the properties of the method when the number of design points 
is hxed and the dimension d varies. For this purpose, we consider 2'^“^ fractional factorial 
designs. We can see on Figurej^the results of the Monte-Carlo study. It seems that there 
is a signihcant improvement of the method when the dimension d increases. This suggests 
that it is always better to explore new dimensions, even if we perform less experiments 
along each direction. 
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Fourier PGA PLS 


Figure 8. Monte-Carlo study of response improvement ^ 

"iCo ) 

Left-hand side: 


the hrst descent step, 
estimation of f 2 - 


after 

estimation of /i, right-hand side: 


5. Application to nuclear safety 


5.1. Data and objectives. An hypothetical cause of nuclear accident is the loss of 
coolant accident (LOCA). This is caused by a breach on the primary circuit. In order to 
avoid reactor meltdown, the safety procedure consists in incorporating cold water in the 
primary circuit. This can cause a pressurised thermal shock on the nuclear vessel inner 
wall which increases the risk of failure of the vessel. 

The parameters influencing the probability of failure are the evolution over time of 
temperature, pressure and heat transfer in the vessel. Obviously, the behavior of the 
reactor vessel during the accident can be hardly explored by physical experimentation 
and numerical codes have been developed, for instance by the CEAQ reproducing the 
mechanical behavior of the vessel given the three mentioned parameters (temperature, 
pressure, heat transfer). Figure [^represents different evolution of each parameter during 
the procedure depending on the value of several input parameters, which can be used as 
a learning sample. 

The aim is to find the temperature transient which minimizes the risk of failure. We 
have access here to the margin factor (MF) which decreases when the risk of failure 
increases. Hence, the aim is to maximise the MF. 


5.2. Generation of design. Considering that the inputs are the three temperature, 
pressure and heat penetration curves, we set El = (L^([0, T]))^ (with T = 5000s) equipped 
with the natural scalar product 


l(AT) (P) (H). . (T) (P) (H).. 


- 


I x\^\t)x^\t)dt + / x^^\t)x^^\t)dt. 


('T'\ (p\ (ffj 

We define the starting point of the algorithm as the triplet (A) qX) qX) ) of the 
learning sample maximizing the response. 

In view of the simulation results of Section [^ and the presence of a learning sample, we 
focus on the PLS basis and generate a functional design based on a minimum aberration 


^French Alternative Energies and Atomic Energy Commission (Commissariat a I’energie atomique et 
aux energies alternatives), government-funded technological research organisation, http: //www. cea. fr/ 
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factorial design 

Figure 11. Monte-Carlo study of response improvement for the approx¬ 
imation of /i with a factorial design, for different values of d and p 
such that d — p = A. 


Temperature 


Pressure 


Heat transfer 



Figure 12. Evolution of temperature, pressure and heat transfer (learning 
sample). Source: CEA. 

(a) (b) (c) 



t(s) t{s) t(s) 


Figure 13. Functional experimental design around the initial curves. 

210-5 fractional design for the temperature, a 2^“^ design for the pressure and the heat 
transfer. As some design points of the functional design around the initial heat transfer 
curve took negative values (which can not correspond to the physic since the heat transfer 
is always positive), we remove it and keep only the design points which are always positive. 
The design points are plotted in Figure [T^ The resulting design, which is a combination of 
all curves of the three designs obtained (for temperature, pressure and heat penetration) 
counts 128 design points. 
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Figure 14. Left: value of the response on the estimated steepest ascent 
direction. Right: solid line initial temperature point, dotted line: optimal 
temperature transient estimated. 




Figure 15. Point of the estimated steepest ascent direction maximizing 
the response. 


5.3. Results. We compute an estimation of the gradient with the results of the exper¬ 
iments on the design points given in Figure The results are given in Figure We 


take Ao = 200. The hnal estimates of the optimal curves are given in Figure 15 


The main change between the starting point and the minimal point of the ascent direc¬ 
tion lies in the temperature transient (the changes in the pressure and heat temperature 
transient are minimal), especially in the evolution of temperature between 500 s and 2000 s 
after the simulation starts and between 3000 s and 4000 s. 
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